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ABSTRACT 


A model of search of an area is developed using the proba- 
bility of detection as the measure of effectiveness. The 
area 1S partitioned into two Seess:. Two search units, with 
different capabilities, attempt to detect one evader. If the 
search efforts of the two units do not overlap, the probability 
of detection is the same no matter how the area is partitioned. 
An approach based upon Game theory is also developed. The 
variance of the probability of detection is computed and 


used to select strategies for searching. 
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in LNERODUCTION 


Throughout history, searching, on one form or another 
has been one of man's constant endeavors. Prehistoric man 
hunted for his food, both plant and animal. The more 
Successful searchers understood the characteristics of their 
quary and search area. They could then eliminate some areas 
from consideration and concentrate cn others. For example, 
if certain plants only grew in the shade, open fields would 
be eliminated from the search area. 

In searches involving people, this characteristic infor- 
mation can be exploited by both the searcher and his quary 
(the evader). If the evader knows the tendencies of the 
Searcher, he can take the appropriate actions to reduce his 
chances of being found. The knowledge of an at ee 
action (intelligence in military terms) is always sought to 
give one side an advantage. Certainly the submarine commander 
wants to know where the convoy will transit, just as much as 
the convoy commander wants to know where the submarine will 
mant [Ref. 1}. 

We can see that to fall into patterns of searching (or 
evading) is analogous to providing the other party with 
information that he can exploit. Since a pattern or deter- 
minant strategy provides information to the adversary, it 1s 
Only logical not to be predictable. Therefore, the searcher 


and evader should be unpredictable, or random, in their choice 





of search actions. Search patterns that are random do not 
fea repeatable results from each trial but certain quanti- 
ties such as the probability of detection are amenable to 
mathematical calculation. 

Bach time the searcher faces a choice with a known set 
@ewconditions, he should choose his action randomly to avoid 
falling into a pattern. If the search action was repeatable, 
the same choice would be repeated each time and hence a 
pattern would develop. 

A prime quantity of interest in a search is the probability 
of detection (POD). The probability of detection is a measure 
of effectiveness (MOE) of the search. The basic problem is 
to compute this MOE. The next step 1s usually to optimize 
the probability of detection. Optimize means maximize to 
the searcher and minimize to the evader. Occasionally other 
pieces of information are required such as the probability of 
Peeection under an extreme, or most probable, set of conditions. 

This paper will explore the problem of one or more search- 
ing units searching for a single evader. It 1s assumed that 
neither party has tendencies that may be exploited by the 
memer tO predict his actions. The actions of the searcher 
and evader are random in that actions or choices are not 
predictable. 

A border search problem will be developed initially. The 
Probability of detection is defined and a cookie cutter model 


7S introduced. The searcher has two search units with 





different capabilities attempting to detect a single evader. 
Following this, a more complex problem is addressed. Two 
search units of different capabilities attempt to detect a 
Pmgte evader in an area which is partitioned into two pieces. 
The area search problem is then addressed as a two person 
zero sum game. Each entry in the payoff matrix is the proba- 
bility of the searcher detecting the evader for the strategies 
picked by each player. The optimal probabilities of playing 
each strategy are computed. The expected value results of 
the game indicate that all pairs of search strategies yield 
the same expected value of the game. The choice of strategies 
is made based upon minimum variance. The search area is 
then partitioned into three pieces and an example is presented. 
The concept of random search is next introduced. The 
evader is allowed the latitude of moving within the operating 
areas. The problem is modeled as a game and the expectation 
and variance are computed. In the case of random search, the 
pair of strategies of the searcher which yield the largest 


expected value of the game would be chosen for the search. 


10 





ii one NATURE OF THE SEARCH PROBLEM 


Search units are generally constrained by range, speed, : 
endurance or other restrictions such as hours of daylight 
available. The time and speed constraints can be combined 
into an effective range? of the searching unit. If there are 
two units available to search a region, it is logical to want 
to find the best way to partition the region to optimize the 
search. Two partitioning problems will be addressed in this 
section. The first is the search of a border. The second 
problem is that of searching an area. Under certain conditions 
and constraints, the area searching problem can be reduced 
to the same mathematical form as the border, or line searching 


problem. 


A. BORDER SEARCHING PROBLEM 

We consider the pPreoolLenveieinsurdents son smugglers attempe- 
ing to cross a border such as a river or an international 
boundary. The border must not necessarily be straight but 
we require that it does not have extreme curvature or corners. 
We define the person, or unit, attempting to cross the border, 
Meme evyader. Let the patrolling perscn, or unit, be defined 


as the searcher. We will assume that the border is very long 


t ange = Average Speed X Endurance. 


ve 





so that at any time the searcher cannot observe the entire 
length of the border.+ 

The objective of the evader is to cross the border with- 
out being detected by the searcher. The searcher's objective 
is to detect the evader when he attempts to cross the border. 
A detection can only occur when the evader appears in the 
field of view of the searcher's sensor. The sensors could be 
acoustic (sonar), electromagnetic (radar), or optical (infra- 
red or image enhancing devices). Of course, the human eye 
is the sensor we are all most familiar with. 

The searcher and the evader have diametrically opposed 
views of success and failure. The searcher considers the 
detection of the evader a success while the evader calls it 
a failure. If the evader is not detected, he considers that 
a success, while the searcher considers it to be a failure. 
The searcher and evader can both observe the same set of 
events aa reach opposite conclusions about success and 
failure. 

Consider the following model of the border search problem 
in Figure 1. This model is applicable while the searcher is 
actively on station searching for evaders crossing the border. 
The evader is attempting to cross the border into friendly 
memercory. The probability of detection is 1.0 1f the evader 


passes within the sweep width W, otherwise it is 0.0. It is 


ithe towers of the great wall of China were constructed 
Bemeie entire length of the border could be viewed simul- 
taneously by many observers. 


IL 





= Sweepwidth 
= Searcher Speed 
= Evader Speed 


= Border Length Evader 


Speed U 






. Border of 


Speed V length §S 


Searcher with 
sweepwidth W 


Figure 1. Model of Border Search 
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assumed that the border length S is much greater than the 
Sweepwidth W. The searcher travels at speed V along the 
boraer. The evader is equally likely to cross anywhere 
along the length of the border. The searcher traverses the 
border in one direction for the duration of his endurance. 

It is necessary to state some further assumptions and 
consequences of the model. We assume that the searcher has 
a much greater sweepwidth than the counterdetection range 
of the evader. Therefore, no evaSive action may be taken by 
the evader. In addition there can be no missed detections 
or false alarms. The evader can only be detected when he 
falls within the sweepwidth of the searcher's sensors. 

The evader approaches the border at speed U, and at an 
angle, 9. The searcher travels at speed V along the border. 
We choose an orthogonal coordinate system, perpendicular 
({) and parallel (//) to the border (see Figure 2) and resolve 
the speed of the searcher and evader into components in this 
coordinate system. 

When the evader crosses the border, he must travel the 
distance L = W/cos 8, in which he is subject to detection. 


The evader traverses L in time t, where: 


Wy _W 
te = L = COS 0 = me = Ww ( 1 ) 
~ UY U U Uy ~ 


We see in Equation (1) that only the velocity component 


of the evader perpendicular to the border enters into the 
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Coordinate system parallel 
and perpendicular to the 
searcher's direction of 


travel 
Un 
@\ Evader 
Speed U 
Sweeowidth 
UL 


~~ 
Searcher 
Speed V 


L= Distance 
the evader is 
exposed 


Hagune 2. vader Attempting to Cross Border 
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time to traverse the sweep width band. It is apparent that 
the evader should not be exposed to possible detection any 
longer than necessary. The evader does not know the searcher's 
direction of travel along S. The speed component U- should 
be as large as possible to minimize the time to cross the 
border. This occurs when the evader crosses perpendicular 
to the border. Under these conditions 6 = 0, 0 = U and 
Ur = 0. In all subsequent developments, the evader will 
cross the border in the most advantageous manner, l.e., 
perpendicular to the border. 

The searcher is not allowed to cover a portion of the 
border that he has already traversed, and only travels in 
one direction. However, he may come to the end of the border 
before he has exhausted his search time. We can prevent this 
from happening by requiring that the searcher always begin 
his search at least VT + W/2 from either end of the border. 

£ he moves toward the end of the border for time T at speed 

V, he is still W/2 away from the end when he finishes the 
search, where W/2 is the search racius. 

The measure of effectiveness in this problem has been 
chosen to be the probability of detecting the evader. It 
may be possible to determine the probability of detection 
experimentally. The initial conditions of a search would 
be determined for the searcher and the evader. The evader 
mould select from a uniform distribution, a point where to 


attempt to cross the border. The searcher would select from 


iG 





Smut rorm distribution, where to start his search within the 
interval VT + W/2 from each end of the border. Then with a 
mene Of a fair coin, he would decide which direction in which 
to traverse the border. A series of these trials would be 
conducted and the number of detections would be recorded. 

The probability of detection would be estimated from the 
ratio of the number of detections to the number of trials. 
The above procedure could be accomplished more easily ina 
Simulation than in a physical experiment. A more appealing 
alternative is to compute the probability of detection directly. 

For a given evader's speed U, the effectiveness of the 
searcher is a function of his speed V, the sensor sweepwidth 
W and the border length S. The probability of detection is 
only defined if the evader is present. The search speed, 
sweepwidth and length of border alone are not enough to de- 
fine the probability of detection, though some information 
is available by taking the ratio of sweepwidth and border 
length. This coverage factor, W/S, is one measure of the 
searcher's capability. 

If the searcher could traverse the entire border during 
the increment of time that the evader was attempting the 
crossing, the evader would surely be detected. If the 
searcher were stationary, the evader would certainly not be 
detected unless he crossed the border in the field of view 
of the stationarv sensor of the searcher. In the first case, 


mie probability of detection is 1.0 and in the second case, 


sue) 





ge 1S equal to the coverage factor, W/S. In the problem 
under consideration, some part of the total length of the 
border is traversed by the searcher during the time that it 
moe the evader to make his crossing. The probability of 
detection is defined to be the ratio of the length of the 
border searched, R (in the time interval, t, that it takes 
the evader to cross the border), to the length of the border, 
S. This is the probability of detection given the evader is 


crossing the border S, i.e., POD|S. Here, 


* * 
ee ee Sse. + ViW/o (2) 


7 S S S 
meere U> 0, V> 0. 

Rearranging terms, the following expression for the proba- 
Pearcy Of detection results: 

_ Ww V 
Povo “eel +), 
Beere 0 > 0, V> 0. 

In Equation (3), W/S is the coverage factor. Consider 
the example where the searcher's speed is V = 0, such as 
when he occupies a watch tower on the border. If the evader 
crosses within his field of view, W, he is detected. Even 
with no speed, there still would be a finite POD. The ratio 
of speeds in the second term represents the increase in the 


probability of detection due to the speed of the searcher. 
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This ratio, V/U, may be interpreted as the dynamic enhance- 
meme Of the static probability of detection [Ref. 2]. 

We will now determine the upper bound on the POD|S. 
Figure 3 shows the allowable interval in which the searcher 


may begin his search. 


= VTHN/2¢he— Interval to start search — VT+W/ 2 >| 
rn 
| ll Border Lengtn S ee 


meeire Ss. interval to Start Search 


During the interval t that the evader is crossing the 


border, 


WY 
V 


Dx | (Siccees YO ee (4) 


Rearranging terms yields 


ZV 
S 


[= 


Recall that t = W/U and substitute into b, yielding 


2VW W 
aaeewouT 5) 
W V 
a > gil + 2 9p) 


dee, 





Since 


_ WwW M4 
POD|S = q(l + a), 
we have 
W jE Vk W we 
LE: gli *: 7 > q(1 an Tp? (3) 
and 


POD Suen 


If we examine the probability of detection (Equations 2 
and 3) we may confirm some intuitive ideas about searching. 
The POD is greater 1f the searcher can see farther (greater 
sweepwidth, W) or cover more ground in a given time (greater 
Beeed, V). The probability of detection is less if the 
evader can cross the border more quickly (greater speed, U) 


Or operate along an expanded border (1.e., increased S). 


Pee L£WO SEARCHING UNITS ON THE BORDER 

In this section we will assume that there are two searchers, 
Unit 1 and Unit 2 searching for a single evader crossing the 
border. Each search unit has a different sweepwidth (Wi and 


Wo) and speed (V5 and V The speed of the evader is U. 


2) - 
The ranges, Ry and R, that represent the search capability of 
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each unit while the evader is crossing the border can be 


eaSily computed. Here: 


_ iL 
Ry = W, (1 + a and 
(6) 
V5 
a ee) 


These equations are of the same form as the numerator in 
Mem@ation (2). 

It is reasonable to have some rationale for the division 
of labor between the two searching units. Suppose that we 
partition the border length, S, into two pieces of lengths 
Sy and S51 where S, + SS, = S. We assign Unit 1 to the length 


1 Z 


of border Si aaa Unmrce 2 to length of berder S as shown in 


OF 
Figure 4. 


tne probabilities of detection of Unit 1 and Unit 2 (in 


S, and S, respectively) are: 
3S 
POD, |S, = = and 
(7) 
R 
: 2 
POD. |S, = S, 


Gimewprosability of detecting the evader, P(Det), is the 
Metal probability, i.e., 


P(Det) = P(Det|S,)*P(S - (IS | Sey) te Shy (8) 


1? 





Remge Ore search Unit 1 Range of Search Unit 2 





Figure 4, Border of Length S Partitioned into Two Pieces 
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where: 


P(S.) = Probability the evader will cross the 
ai ; . 
border in segment Sis P= 128 


Since the evader is assumed to be equally likely to 


cross the border anywhere along its length, 





P(S.) = . (3) 


Now, reducing Equation (8) using Equations (7) and (9) gives: 











ood 
P(Det) = at oe = wi = =, (10) 
ders Og 7. 2. ee ie 2 
where: 
R, +R, = R = the total non-overlapping length of 


the border patrolled by the two 
search units. 

The implicit idea in partitioning the border was to do 
it in such a way that the probability of detection was opti- 
jmezea. We see from the form of Equation (10) that the par- 
titioning of the border into two individual segments has no 
erect on the overall probability of detection. This is the 
Besult of the evader being equally likely to cross the border 
Ge da@hy point along its length, and of not allowing any overlap 


by the search units. 
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C. TWO SEARCHING UNITS IN AN AREA 

The next logical extension of the searching problem is 
to search an area instead of a border. We will consider two 
search units in an area, searching for an evader who is 
Operating at a fixed location. If the area swept by a 
search unit's sensor contains the evader, there is a detection. 
Otherwise there is not. 

The following information describes the capabilities and 


Semsteraints of a searching unit: 


V = Search speed, 
ior=—.— Searching time, 
W = Sweepwidth (POD of the evader = 1.0 within 


W, zero otherwise), and 


a = Area searched = WVT + ae (ime fame Tf): 


In Figure 5 we see that the area swept (searched) ina 


Semen interval T by the searcher, consists of displacing the 





initial sweepwidth circle a distance VT. If the search time, 
Zz 
Meets SULficiently large such that WVT >> te, then the area, 
a, can be approximated by: 
a. Wie. (12) 


We have assumed that the evader is operating at a specific 
location, such as a field headquarters, within an area, A. 
He will remain at this location, and cannot move to avoid 


the searcher. We continue to invoke the principle of 
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randomness. This means that the searcher does not know 


where to search for the evader nor does the evader know where 


a 


" 


is 


Sweepwidth 
Searcher's Speed 
Time Searching 


re 
HoM dt 


Figure 5. Total Area Searched 


the searching units will look for him. Further, we assume 
that the evader is equally likely to be anywhere within the 
area when the search is initiated and the searcher is equally 
likely to begin searching at any point within the area. The 
searcher then begins the search with the objective of detect- 
ing the evader. 

The measure of effectiveness of the searcher is the proba- 
bility of detection, POD. The searcher would like to exhaus- 
tively cover the whole area and if he did the POD would be 
1.0. Otherwise the POD is the ratio of the area searched, 


a, to the total area A, or 


EOpl| A a =, (13) 





Figure 6 shows a rectangular area, A = hS, which may 


contain the evader and the area a covered by a searching unit. 


Area of Search: A = hS 
Swept Area: a = WVT 


W 
iy 
m 
ee Evader 
: 
Figure 6. Rectangular Search Area 
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An area searching problem involves two dimensions. Under 
some circumstances, we can fix one dimension of the rectangle 
and only nave the other one variable. For example, if we 
were searching for an airplane that flew over water along 
a track ten miles from the coast, we may search out to sea 
as far as twenty miles along some length of coastline. Thus, 
we have fixed one side of our search rectangle but the other 
dimension, along the Coast, would still be chosen to reflect 
realistic bounds on the problem. We now substitute the total 


search area hS, for A, into Equation (13), which yields: 
Sega 
POD|JA = Ae (14) 


The term = is a constant. Now, if we compare Equation 
(14) with Equation (4), for the one dimensional border search 
problem we see that the mathematical form is the same. 

Now, we will expand the problem to two searchers. Two 
searchers, Unit 1 and Unit 2, with different sweepwidths, 
speeds and search times will sweep areas ay and a, respec- 


tively. Here, 


The two sweot areas ay and a, are not allowed to overlap, 
and of course must be within the overall search area, A. The 


Search area, A, iS partitioned into two parts, one of size 


aa 





A, searched by Unit 1 and the other of size A, searched by 


Maat 2, so that 
(16) 
It 1S assumed that the evader is equally likely to be 


at any point in the search area. Therefore, the total proba- 


bility of detecting the evader is: 


aia, ot a5 
P(Det) = ~>——— = <=, ley) 
A, + A, A 
where: 
a, + a, = a, the total area swept out by both 


search units. 


The conclusion in the area search is analogous to the 
border search; the probability of detection is not affected 
by the partitioning of the search area. 

We have found for this problem that there 1s no way to 
partition the search area and improve the probability of 
detection. The POD can be degraded* Butenmet improved. In 
the next section, we shall model the search as a game and 
exploit the fact that the searcher and the evader have con- 


mercting goals. 


tay overlapping search areas. 


28 





III. MODELING THE SEARCH AS A GAME 


Up to now, the information that we have obtained is that 
the probability of detecting the evader is (a, +a.) /A 
regardless* cof how the searcher chooses to allocate the two 
searching units. We will now expand the problem to allow the 
searcher and the evader alternative courses of action. The 
partitioning of A will define a choice for the evader. He must 
choose to locate in either A, or As, and thus the evader has 
only these two choices, to operate (hide) in A, or A,. The 
partitioning of the search area also provides the searcher 
with alternative courses of action on how he allocates his 
resources. 

The theory of games is useful in analyzing conflicts be- 
tween opposing parties [Refs. 3,4]. The two players in this 
game are the searcher and the evader. The conflict is that 
the searcher wants the probability of detecting the evader 
to be high while the evader wants it to be low. 

A game matrix is constructed from the outcomes of all 
possible courses of action of the two players. We have assumed 
that the searcher partitions the search area, A, into two 
pieces Ay and A.. We will further assume that this parti- 
tioning is known to the evader. This does not impart any 


information to the evader about the searcher's course of 


al —e 
Peev2ding there is no overlap of search areas. 


ERS, 





action, i.e., the area in which he will search. The only 
restriction on the partitioning of A is that each of the 
two pieces, A) and Ao, be at least as large as the sum of 
the search capabilities, ay and Ass of the two searching units. 
The searcher has several ways that he can allocate his two 

search units to the operating areas. The four alternatives 

of the searcher that involve both searching units are pre- 

sented in Table 1 below. The entries in the matrix identify 
which search units operate in each of the two areas, Ay and 
A. - 


lees 1. P@SSIBLE STRATEGIES OF THE SEARCHER 


Searcher 


Demacegy Ay A. 





S None Unaes cl & Z 


For completeness, the evader's strategies are shown in 


Table 2. 
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TABLE 2. Possible Strategies of the. Fvader 


Evader 

SGrategy 

Ey Lecate in Ay (Not A.) 
E. Locate in A, (Not Ay) 


This situation may be treated as a two-person zero-sum game 
characterized by a payoff matrix which specifies the results 
of all possible combinations of the strategies of both players. 
In our case, the entries in the payoff matrix are the proba- 
bilities of detection of the evader by the searcher. For 


example, if the evader hid in A, (Strategy 2) and the searcher 


2 


chose his strategy Sy (where Unit 2 searches A, and Unit l 


2 


searches in A the probability of detecting the evader 


ie 


would be ao/A If the evader chose his strategy E. and the 


1° 
searcher chose his strategy Sy) the probability of detection 
would be (a,+a,)/A,.- In game theory, it is conventional to 
present the payoff matrix with favorable payoff to the row 
Peetyer. The probability of detection is a measure of success 
of the searcher. Therefore, the searcher will be the row 
player and the evader will be the column player. The payoff 


Matrix for the game is presented below in Table 3. It 1s 


useful to establish a hierarchy of the payoff quantities. 


ey 





TABLE 3. PAYOFF MATRIX FOR TWO SEARCHERS_WITH AREA PARTITIONED 


BEvADERS* SURAIEGIES 








eo Eo 
2 a 7 
al Ay A, 
“2 oa 
2 Ay A, 
Searchers 
Strategies 
S Sy Say) 
3 = 0 
l 
S Si ae 
0 A 
> 


We will call the more capable search unit, Unit 1. This 
means that Unit 1 sweeps more area than Unit 2 during the 
search, i. Soe ay > a, - We will call the larger of the two 
search areas Al, Bi Cos, A, > A5- We lose no generality with 
these assumptions. 

We will examine the case when a,/A, > ao/A, in  aetail. 
The second case, when a,/A, < ao/A, may be analyzed similarly. 
It is convenient to replace the entries in payoff matrix 


(Table 3) with the symbols in Table 4 below. This will be 


useful later when we analyze the game. 


oy 





TABLE 4. SYMBOLIC PAYOFF MATRIX 


ik 2 
Sy fo Rg 
S5 Y 6) ; 
e.g., B= = 
2 
S 3 Y+y 0 
Sy 0 B+ 6 


a 
Slmce = > = Gao 08: 
J 2 
Bame@e a, > ani a > ¥ SVG Wey esa eye 
pee Said 9B y. 


meemee A. > A-;: 


Maes yields the following hierarchy, 6 > a> £8»> y. Also 


mee 6 > a andg > y:; B+t6 PO at y. 


Therefore, 


SS 





and 


a ta a tay 
z al 








This still leaves the relationship between a,/Ay and 
(a, +a.) /A, unknown, but as we will see later that it does 
not affect the outcome of the evaluation of the game. 

We will now consider two examples. The dimensions would 
be chosen to be the same (e.g., Sq. kilometers). They will 
cancel out of the equations for the probability of detection. 
The important point in the examples that follow are the rela- 
tive sizes of the area to be searched and the available 


Somer ity to search. 


feempie 1. Two search units searching for one evader where, 


aA = 100, A, = 60, and A, = 40; 
a = 20, a, = 5 ean a, = 5 
Note that 
a a 
ile 2 
ay > a5) A, As, and 5, * Ro 


Substituting these values into the payoff matrix yields: 
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Sy, ap 
; 15 Es 
1 60 40 
‘ = 15 
2 60 40 
S 5415 
3 E07 0 
S 5+15 
4 0 ZO 
. is 20 
Meee that 6 > aty in the matrix, i.e., 7? Z0° Leo nore 


Genvenient to deal with a matrix of integers than fractions. 
Therefore we multiply each entry by 24. This scales the 
value of the game by a factor of 24 and the following game 


matrix results. 


EL E, 
Sy 6 B} 
S5 2 9 
S 3 8 0 
Sy 0 iz 
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Two search 


Example Ze 


where, 


A = 270, A, 
a = 100, ay 
Again, note that a, > a, 


SwSstituting into th 


om 

=) 
4 

he 

4 
We see here that o < aty 
of 6 and aty are reverse 
solve the games, we will 


outcome since the order 
been established. 


We multiply all of t 


units searching for one evader 


=—esO 7 -and A, = 120; 
= 60, and a, = 40%, 
a a 
Je 2 
7s > A and —eo- —. 


e payoff matrix yields 





EL E. 

60 40 

0 Ae. 
Ue 170 

0 
0+60 0 

iLSi(0: 

0 40+60 

eZ 
; 60 100 F 

¢ LboSe-> Tol TES The hierarchy 
d in these two examples. When we 


see that it does not affect the 


of all of the other parameters has 


he entries in the matrix by 30 to 


obtain the following payoff matrix. 
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Ey E, 
Sy eZ 10 
S5 8 i> 
S 3 20 0 
S4 Q ZS 


We will evaluate the game according to the minimax 
theorem. This dictates the manner in which both the searcher 
and the evader must choose their strategies and the value of 
the game that results from these choices. The details of 
evaluating a game subject to the conditions of the minimax 
theorem are presented in Appendix A. 

At this point, we may solve the 4x2 game in Tables 3 and 
meee analytic solution is preferred but is not possible in 
an Mx2 game (where M > 2). We can solve the underlying 2x2 
games analytically. For the Mx2 game, we would resort to a 
graphical solution. This requires that the entries in the 
payoff matrix are specified numerically or at least the 
hierarchy of the elements is established. The examples are 
plotted in Figure 7 as a function of the evader's strategies. 
mer Clither game, we can see in Figure 7 that the four strate- 


gies of the searcher all intersect at a single point. The 


af 
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Example 1 Example 2 
B+¢ 
aty 
a 
D5 6 
8+ : 
Sy Q 
6 
i 
a 
38 
ef 
0 Pr (E,) i 0 Pr (E.) 1 
Figure 7. Examples of 4 X 2 Games 
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general 4x2 game would have six intersections of the strate- 
gies (4 things taken 2 at a time). There are only two inde- 
Peneent strategies, defined by a, 8, y and 6. The other two 
strategies can be constructed from the first two by elementary 
matrix operations. This is shown in Appendix C. 

The intersection of all four strategies of the searcher 
are at the same point. This is the value of the game which 
is (a,ta,)/(A,+A,), as expected. 

The probability of detection computed as the value of 
the game is the same as computed previously by taking the 
ratio of areas. The searcher could choose any of his four 
pairs of strategies 1-2, 1-4, 2-3 and 3-4. If he plays the 
strategies optimally, he would achieve a probability of 
detection equal to (a,+a,)/(A,+A,). 

All six subgames are analyzed in Appendix B. Two of the 
games have saddlepoints. The optimal strategies of the 
searcher and evader are computed for the remaining four games. 
Any single search is a Bernoulli trial which results in either 
a success or a failure. When both players choose their 
Strategies optimally, the expected value cf the probability 
of detection is the value of the game. 

© is shown in Appendix B that the value of the games 
are the same. We can see from the grpahical display of the 
Game, Figure 7, that some pairs of strategies range over more 
extreme values than others. Compare the pair of Strategies 


l1 and 2 with 3 and 4. We see that there is more potential for 


oo 





fluctuation of the results in 3 and 4 where the values may 
possibly range from zero to §8+é6. The game with Strategies 
1 and 2, on the other hand, has a smaller range of possible 
values, from y to 6. 

We have four 2x2 games with the same value. In accordance 
with the expectation-variance principle of choice for deci- 
Sions, the choice of which set of strategies to use for 
searching should be based on the minimum variance. By choos- 
ing the alternatives providing minimum payoff variance, the 
risk of achieving a probability of detection substantially 
less than the value of the game is minimized. A similar 
argument has been advanced about investment portfolios [Ref. 
5]. If all portfolios have the same expected return on invest- 
ment, the portfolio with the largest variance is the one with 
the greatest risk. Conversely the portfolio with the least 
variance has the least risk. 

If we look at the combinations of strategies in Figure 7, 
we can see that searchers' Strategies 1 and 2 vary the least 
with respect to the expected value. Therefore, we may select 
the alternative with minimum variance by inspection. The 
computations presented in Table 5 confirm this. 

One result of modeling the search as a game is that it 
allows us to compute the variance as well as the expected 
value of the search strategies. The variance computation of 
a 2x2 game is described in Appendix A. The variance and 
Standard deviation for each of the 2x2 subgames in the two 


examples is shown in Table 5. 
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TABLE 5. VARIANCE AND STANDARD DEVIATIONFOR EACH STRATEGY PAIR 


Example 1 Example 2 
Strategy Pair Variance Sta. Dev. Variance Sed. Dev. 

1-2 .00875 .094 -003841 Ola 
1-4 eOmS ule [00372 ey 
2-3 302303 Prdlsy | reise IL SIRS TS 
3-4 .0400 . 200 5 les eile oe 
Value 

ef 20 oe 0 
Game 


feeeeeanlLeNSLON TO MORE SEARCH AREAS 

The game approach to searching can be applied to problems 
involving three or more search areas and searching units. 
At this Dent the combinations of ways to search become very 
large. For example, if there are two search units and three 
areas to search, we can count nine ways to put the two 
searchers in the three areas and thus nine pure strategies 
for the searcher. This would lead to @) = 84 3x3 games to 
analyze. 

One simple example is where one searching unit looks for 
one evader in one of three different regions. This is similar 


to trying to pick the walnut sheli that has the pea hidden 


under it. Of course if you pick the right shell (search eérea) 
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me probability of detection is 1.0. 


this search model is shown below. 


il Z 
S5 0 P.5 
S 3 0 0 


Using the method in Epstein [Ref. 


strategies of NxN games, we find 


Dy 
P(E.) = P(S.) = 
1 il el Po5 - P. 
Pp P 
iy 
freee) 2 6©= P(S.) = 
Dis, 2 Pi) Pon + PS 
P(E.) 2(S.) eae 
3 3 Pia Poo + Po 
P P 
je 3 3 
and a 
eal ee Soo ose 
igi Ply = P.5 = P.3 = P, and 
= = 7a, 4 
P(S,) P(E.) / 
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then the value of the game P/3, the variance = ey oe 
and the standard deviation = P/V3. 

The searcher and evader would play each of their strate- 
gies with probability 1/3 and achieve a probability of detec- 
Brom (payortft) equal to 1/3 of what it would be in any of the 


three areas. 


If P = 1 (the shell game) then 


Pwooaoiiity Of Finding Pea = 1/3 


a 


Variance of Probability = 1/3 


Standard Deviation = 1/V/3 , and 


Walue of Game + Standard Deviation = 1/3 = 1//3. 


We have analyzed search problems involving stationary evaders 
uSing game theory. It 1s possible to expand beyond 2x2 games 
but the potential combinations of strategies grow very quickly. 
Next we will address searching for a moving target which we 
will model with random search. We will continue to use 


game theory to analyze the probiem. 
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iV. RANDOM SEARCH 


The concept of random search was introduced by B. Koopman 
in 1946 [Ref. 1]. in random search, the evader may move into 
an area already covered by the searcher. Therefore, even if 
the searcher covers the area exhaustively, he may not find 
the evader. By repeatedly covering the area, the POD then 


Bees asymptotically to 1.0. This model for the POD is the 


exponential 
PO) Ss 1 fee 
where: 
a = Area swept by search unit, and 
A = Area in which evader is operating. 


The POD aiways increases with increasing coverage in the 
random search model. Random search always gives a smaller 
value for the probability of detection than the ratio of areas 
model, as shown in Table 6. 

The next step in the development of the search problem is 
to allow random search in our previously developed examples. 
The evader is now free to move within the partitioned area 
Meace he has chosen, but is not allowed to cross the partition 


between A, and A.. We continue to model the problem with the 


a 


four searcher strategies previously described. The entries 
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TABLE 6. DETECTION PROBABILITY COMPARISON 


a/A Random Search Ratio of Areas 
Bas So) PAI P2500 

.5 ooo 55 BS ehe 
se no opanl 1.0000 
2.07 . 8647 i. 0000 


in the payoff matrix are now the probabilities of detection 
using random search. The arguments of the POD are the as and 
A. shown previously. The general form of the 4x2 game matrix 


is shown below. 


| Be 
=m -e ya, Pa "7x, 
S. Ire sa, ee 
ae if A, 0 
S, 0 pee P72), 


q ' 
Sin the ratio of areas model, once the area is covered, 
the POD = 1.0. Additional coverage is redundant. 
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Poomete lt. Whem we use the previous values, a, = 15, a, = 5, 


i 2 
Ay = 60 and A. = 40, we obtain: 
E, E. E, E. 
a een 3 oes = S, 22120 11750 
an eee ape S, 07996 31271 
S, t-e 173 0 S, eed] 0 
S, 0 leg be S 0 39347 
4 
Beample 2. Similarly, we use the values a, = 60, a, = 40, 
Ay = 150, and A. = 120 to obtain: 
By Eo al Bs 
S, eee? revere = Ss, 32968 28347 
S., eet epee Se 23407 2 7 
S 1-e -/? 0 S 48658 0 
3 3 
5G _ 
S , 0 Lae a 0 56540 
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It is useful to consider some other examples using random 
search where the coverage factor is greater than 1.0. The 
same four searcher strategies will still be used while the 
parameters a,j, a5, A, and A, will be chosen to give coverage 


factors greater than 1.0. 


Ememple 3. A = 500; A, = 400; A, = 100 
au=— 300: ay = 200; a, <3 1000, 
ev = L “2 = 3 = i = = 2 
Ay De As Ay 4 As 
2 29 al Bo 
3) fee 172 teen Sy . 39347 ,6 3212 
S, 1-e 1/4 kee Se LM0 86466 
S ee -73 0 "co 27a 0 
3 3 
S 0 eer? S 0 95021 
4 4 


il 
wf) 
un 
ro) 
a 

Il 
}— 
un 
ro) 


Example 4. A = 500; A, 


iI 
finns 
oi) 
© 
fy 

iI 
Ut 
SS 


a = 200; a 
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“1 2, 2 ee ee ee ee 

= 44° 3) «7 63, 

a Eo Ey Eo 
S1 ie 2 jeerese S,  .34856 28347 
S, ema heey Som floaty 63212 
S, ieee! 0 43528 0 

3 

S, 0 hace we S, 0 73640 


We next address all the 2x2 subgames in each example and 
compute the value of the game, the variance and the standard 
Beeeacion. In Example 3, the S, S, game now has a saddle- 
point since the hierarchy of the elements within the payoff 
matrix have changed. The data is presented in Table 7. 

We see that the random search results are different than 
the area search results. The expected value of the probability 
of detection in Examples 1 and 2 is lower as expected. 
According to game theory, we would chocse the pair of search 
strategies which yield the largest expected value. In all 
cases this is the S,-S5 pair. Further, we can see that this 
pair of strategies has the smallest variance. We also see 


that the diminishing returns effect of random search produces 


lower expected payoff in the more extreme search patterns. 


Strategy 


Palr 


TABLE 7: 


A=100;: a=20 
A= 60; a=15 


A= 40; a= 5 


Example 1 

Vol. oe. 
wlio?  .07667 
piv 206>57. 10038 
meg? 2 .12552 
wl6a77 .16477 


Dev. 


EXPECTED VALUE 
DEVIATION FOR RANDOM SEARCH EXAMPLES 


A=270; a=100 
A=150; a= 60 


A=120; a= 40 


AND STANDARD 


A=500; a= 300 
A= 400; a= 200 


A= 100; a=100 


A=500; a= 200 
A= 250; a=150 


A=150; a= 50 


Example 4 


Val. Std. Dev. 


Example 2 Example 3 
Val. “Sed. bev. Val, Sta. bev. 
.30819 .04281 .43525 .13486 

. 30477 .08057 

ES Sie) | Med SS12)2)) Be Slo\s) 2/7) Marsa loyal b 
LOL soem ololE mee oI25,. 455925 
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V. SUMMARY 


The game theory approach to modeling search is useful 
when one wants to gain more information about the problem 
than the probability of detection. If each alternative 
yields the same expected value, the choice among alternatives 
would be based upon minimum variance. The alternative that 
yields the largest expected values would be chosen by the 
searcher, if the expected values were all different. In some 
particular applications it may even be desirable to select 
the alternative with the largest variance or some function 
of the expected value and variance. The user can learn more 
about the potential outcomes of his problem by examining the 
results of the game model. He now has the variance available 
to further describe the outcome. He would use the area ratio 
Or random search model (whichever was applicable) for the 
Beepebility Gf detection. 

An interesting area for future work is relating the ex- 
pected value predicted by game theory to the probability 
of detection determined by experiment, since experiments 
t#nat are expensive or physical situations that occur infre- 
quently don't allow for many repetitions. 

In a game situation the outcome is determined by the 
strategies chosen by each player. It would be interesting 
to know the relationship between the outcome of the game and 


ae Variance and the probability distributions of each player 
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and their variances, and the number of times that the game 
is played. 

It is hoped that this approach to search using game 
theory is useful to those in the operations research com- 


munity and that 1t may stimulate further work in the area. 





APPENDIX A 


GAME THEORY CALCULATIONS 


In this appendix, we will develop the optimal probabili- 
ties for the searcher and evader when they play the game 
according to the minimax theorem. We will also compute the 
value of the game when each player uses these optimal 
probabilities to select his strategy. 

The payoff matrix by convention is the payoff of the 
@emeumd Dlayer to the row player. Since the probability of 
detection is a positive payoff to the searcher, we will make 
the searcher the row player and the evader the column player. 
Pmoener common convention is to call the row player Blue and 
the column player Red. We will use the terminology of the 
problem, searcher and evader. 

A zero sum game represents an exchange between two players. 
Whatever the column player considers to be detrimental, the 
row player considers to be beneficial and vice versa. £ the 
payoff matrix represents a phySical exchange (of money, for 
example) the term zero-sum is clear. In our case the proba- 
Mmerity Of detection of the evader may be considered a loss 
to the evader and a gain to the searcher. 

The searcher and evader play the game according to the 
minimax theorem. This says that the row player, the searcher, 
selects his strategies to maximize the minimum expected pay- 


off. The column player, the evader, selects his strategies 
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to minimize the maximum expected loss. These two expected 
values are called the lower and upper value of the game. 

The mix of strategies that maximizes the minimum expected 
gain for the row player is called the optimal mix of strate- 
gies. This assures that he will gain at least the lower value 
of the game. A Similar argument for the column player says 
that his optimal mix strategies would assure him of a loss no 
greater than the upper value of the game. One of the elegant 
features of game theory is that when both players select 
their strategies optimally that the upper and lower value of 
the game are equal. This is then simply called the value of 
the game. The value of the game is the expected value of 
the probability of detection when the searcher and the evader 
randomly select from their optimal strategies. 

A game with a saddlepoint occurs when the minimum of the 
column maximums is equal to the maximum of the row minimums. 
Games with saddlepoints are played in only one way. The row 
player and column player each select the same strategy for 
every play of the game. The payoff will be the same after 
every play. A game should be checked for a saddlepoint since 
the optimal strategies and the value of the game formulas 
(that we will develop next) do not apply if a saddlepoint 
exists. The optimal strategies of the searcher and evader 
are developed as follows. Consider the 2x2 games (Eq. A-1) 


below: 
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Evader 


al Eo 
21 = iL rae 
Searcher (A-1) 
22 Foal oe 


where: 


EL and E, are the evaders' strategies; 


Si and S5 are the searchers' strategies; and 


Be is the payoff by the evader to the searcher when 
J the searcher chooses strategy i and the evader 
SA@OSeS Strakegy }. 


I 


If no saddlepoint exists, the two largest elements in a 
2x2 game will be a diagonal of the payoff matrix. 

Let Poy > Po. Ea 2 Poi: The payoff may be graphed 
(Figure 8) as a function of the mix of strategies. The 
maximum expected loss by the evader is shown by the darkened 
upper line segments. Since the evader plays to minimize the 
maximum expected payoff, he would play at the point where the 
two upper lines intersect. This means that he would play 
strategies Ey and E, with probabilities 1-Y and Y as shown 
moeeigure 8. 


To solve for Y we equate both lines at the intersection 


of the two straight lines which yields: 





Higuce 8. (Graphically Solying for 
the Evader's Strategies 


P + (P 


21 mom ee Pay CPF)? (A~2) 


UD Ja 


Pelving for Y and 1-Y yields: 


ae aise 
E iklh, Sueno es “ont 
(A- 3) 
— se 2 ar +P 
le oe ae 


The evader will now select his strategy randomly from Ey 


and E. faeetieeye probabilities 1=-Y and Y, respectively. 








prguce 9. Graphically Solving for 
the Searcher's Strategies 


The solution for the searchers’ probabilities distribution 
is analogous. The payoff is plotted as a function of the 
percent of the searchers' strategies in Figure 9 above. Since 
the searcher is playing to maximize the minimum payoof, he 
is solving the graph from the bottom up (vice the evaders' top 
down). The searcher operates at the intersection of the two 
lines. This is the maximum of the minimum expected payoft. 

We solve for the probabilities of the searchers' strategies 
by equating the two straight lines at the intersection which 


yields: 


S10 





_— iat ie 
Tw i> oT, 22 
(A-4) 
— a a 
eee 12) =o] oD 
where: 
1-X = Probability of playing Sis and 
X = Probability of playing S5- 


The value of the game, V, is the expected value which is 


determined from the following equation. 


ume X) (1-Y)P), + (1-X)¥P,, + X(1-¥)P,, + X¥P,,  (A-5) 
This reduces to: 
7 TO) aoe a) 
aia op ep (A-6) 
ial 12 pal DD 


Mmemoavyott matrix fully describes a game. The value of the 
meme and the probabilities of each strategy are a function 


Of the payoff matrix. 


Variance of a Game 
A convenient computation form for the variance of a 


quantity X 1S 


Toe) BIC) = BX) 


a 





7 


We simply compute each of the quantities on the right 
hand side of the equation and subtract. The game G is des- 


cribed by the payoff matrix P where: 


FT E, 
= Lal ra 2 
P — 
=3 EAL oy 
and Si: So, EY and E, are the optimal strategies of the 


searcher and evader. 


Be. 2 2 2 2 
E(G°) = SjEL Phy + S1E5P)5 + S5E)P5) + S5E5P55 
micy- = (S.E.P + S.E._P + S.E_P + S.E.P..) 7 

ee ee Dae Z Zoe 2 go 2 22 


The variance then is the difference between these two 


SMantities, 1.e., 


Var(G) = E(G) - E(G) 
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APPENDIX B 


EVALUATION OF GAMES 


The 4x2 game under consideration is described by the 


mollowing payoff matrix: 








iL 2 
: “1 "2 
iL A, A. 
: “2 “1 
2 Ay A. 
; a, tan ; 
5 A, 
: 5 a,ta, 
+ Ao 
We impose the following conditions: 
215 aes pe and = > #2 
i Das IL 2 Ay A 
2 
and make the following substitutions: 
a a a a 
ab 5 2. 2 1 
= Sie = aaa, (Hoc 916. =). 
yy mo a ey 


Besulting 1m the hierarchy 6 > 4 > 8 > y, and payoff matrix, 


S)2) 





B+6 





0 
Pr(E.) 1 


Figure 10. General Plot of 4x2 Game 


By Eo 
S3 oO 8 
S5 Y 6 
S35 at+y 0 
Sy 0 B+6 


It is more convenient to work with this general matrix. 
Vowilewed@emcrarily Choose @, $8, Y and 6 according to the 
hierarchy and plot the game as a function of the evader's 


strategies. 
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We see in Figure 10 that there are six intersections of the 
four strategies. This is the general form of the 4x2 game. 
This would indicate that the evader would solve the game from 
the top down and choose strategies Sy and Sy: But because 
of the partitioning of the search area and searching effort 
m@g@aethne definition of a, 8, y and 6, this is not strictly 
correct. We will not solve all possible 2x2 games and show 
that the lines all intersect at a common point because of the 
Seermition of a, 6B, y and 6. 

We will use the paired notation ij to indicate which pair 
of the searcher's strategies we are considering. All possible 
2x2 games are shown below. We find the row minimum and column 


Maximum and check for saddlepoints. 


1 2 al 2 
x 
Sy O B B Sy OL B 8 
12 is 
S5 Y 6 Y S 3 Curr oy 0 0 
C 6 at+y oy 
ae a> =r =D 
Sy O 8 8 S5 Y 5 / 
14 22 
S4 0 B+6 OQ S 3 aty 0 0 
OL B+6 at+y 6 


ayak 





ay & 
S, Y 6 " S3 at+y 0 0 
24 34 
S4 0 B+6 Sy 0 B+6 0 
i a+y B+6 


We see that games 13 and 24 have saddlepoints. Next, all 
Six games are plotted in Figure ll as a function of the 
searchers strategies. The cperating points (or solutions) 
for the searcher are shown by the heavy dots. The individual 
games for the evader may be culled from Figure 1 by taking 
all six possible pairs of searcher's strategies. For the 
case where a = a,/A,: 8 = ao/A5, etc., we will show that the 
Memes ali intersect at the same point. 

We will solve all six games for the optimal strategies of 
the searcher and the evader and the resulting value of the 


game. We will use the following notation: 


ee 


Value of the game using searchers strategies 


i” if oana 1, -and 
EY? = Fraction of evaders Strategy K played 
against searchers strategies i anc j, 
where: 
1 = lto4, i j 
5 = oe ae 
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6 
8 
Y 
S, S 
8+6 
a 
8 
0 
eae. S4 
R+6 
re) 
Y 
0 
S, S, 


Figure 11. All Possible 2 X 2 Games 
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Cary. 


oO + 


(Ad 
+ 
Or 


( 





Evader or Searcher, 


= 
It 


K =<) i re 


We will solve the value of the game for 


and the evader against Si S5: 


z= o a 
°? B=-yt+s6 °% 5 
A =P 8 ea ee 

“al ~~ @- B-yFts 2 25 7 
E - S _ = CIC = ai 
eee io 14 mG SY 


both 


the searcher 


lee 
4 
On» 


Against S)S3- there is a saddlepoint game with value &. 


Against S1S4 














le eae © oe 2 8 
eas) ~ ges’ 
14. 6 1A OL 
Ey ~ gq + 6 E4 — q+ sé ° 
" x — alg + 6) 
a” = 1 {sie Sans 
Against S5 37 
3 a + 6 2 a+ 4 
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Against S5S4, there is a saddlepoint game with value jy. 


Against S 3 4! 
4 a+tBp+ty +46 °3 a+tBtyto °% 
n34 tes B + 4 n34 a Chic ty 
ik ~ ate +y +6 72 a+rkeBp+tyt+é? 
veo ze yp =e y Treo Roe OS mores, 
34 34 34 a+B+y +o 


In general, the evaders strategies oe are not the same for 


arbitrary a, 8, y and 6 obeying the hierarchy. But when 


a, 8, y and $6 are defined as a,/A,. etc., we see that 


ie 14 _23 34 
me o- =, = E; ae 


Similarly if we substitute the value of the game we see 


— = \ = Th 
that Vi2 Vi4 V5 3 V24° his means that the game 
Strategies all intersect at the same point, as in Figure 6. 
Therefore, the value of the game is (a, t+a,) /(A)+A,) as 


expected. 
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APPENDIA C 


CONee neCliNG STRATEGIES 


There are four independent quantities that describe the 
search problem with two searching units and an operating area 


partitioned into two pieces. They are: 


The searcher's strategies Sy and S5 played against the 


@vaders strategies E, and E5 yield the following payoff matrix: 


Or 


2 ¥ 


The searcher's strategies S3 and Sy played against the evacder's 


strategies Ey and E5 yield the following payoff matrix: 


Ey Bs 
S3 Clee! 0 
S 0 B+64 
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Strategies S3 and S, May be expressed as a linear sum of 


strategies Si and S5 as follows: 


OG) -B (aty) a B aty 0 


_ 
ae- 6 Y 


-y (8+6) a(B+6) Y 5 0 B+6 
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